Search AI Products and News

According to TechCrunch, voice AI company ElevenLabs now allows authors to publish AI-generated audiobooks on its reader app, following a previous partnership with Spotify for AI-narrated audiobooks. ElevenLabs, which raised a massive $190 million last month, began inviting authors to pilot the publishing program last year and has now opened it to all authors. The company aims to provide affordable and easy-to-use audiobook creation tools to reduce production costs and compete with Audible.

Recently, a research team from the University of Illinois at Urbana-Champaign, Sony AI, and Sony Group introduced a new technology called MMAudio, which aims to achieve high-quality audio synthesis from videos through multi-modal joint training. The core innovation of MMAudio is its ability to generate synchronized audio using video and text inputs, thereby expanding the application scenarios for audio generation. MMAudio is designed to support generating sound effects that align with video content from either video or text inputs.

In the fields of music and sound creation, the combination of technology and creativity often faces numerous challenges. Existing AI models typically excel at specific tasks but lack broad adaptability, limiting AI's auxiliary role in music production. To better serve music and audio production, there is an urgent need for a versatile model that can flexibly respond to various creative needs. Therefore, NVIDIA has launched Fugatto, an audio generation and processing model with 2.5 billion parameters. Fugatto is designed to...

Google announced on Thursday a significant upgrade to its AI note-taking and research assistant NotebookLM, bringing users a smarter and more personalized experience. This update focuses mainly on the highly anticipated audio overview feature, allowing users to guide the AI-generated conversation content more precisely, concentrating on specific topics rather than just generating comprehensive audio summaries. Since its launch last month, the audio overview feature of NotebookLM has rapidly gained popularity due to its podcast-like AI-generated conversation format, with many users beginning to share their experiences on social media.

Shenzhen Riecho Technology Co., Ltd. recently issued a statement confirming that the audio portion of the audiovisual materials circulated on September 16 was cloned by the suspect using its self-developed Reecho AI voice generation model platform. The audio is derived from a live broadcast segment by Lu. The company has initiated an internal review mechanism to strengthen user identity authentication and audio generation security management to ensure the lawful and compliant use of the technology. Reecho stated that as a startup team established less than a year ago, we are committed to frontier technologies in audio and anthropomorphic artificial intelligence.

Pindrop has launched Pulse Inspect, a web-based audio and video file detection system that accurately identifies AI-generated speech with 99% accuracy, as part of the Pindrop Pulse product suite. The tool's unique capability lies in its ability to recognize audio generated by various AI tools or models, and it is currently in preview, designed to serve organizations aiming to prevent audio forgery risks on a large scale. With the rise of text-generating AI systems, audio forgery has become prevalent, making Pulse Inspect essential.

Voice cloning company Resemble AI has released the next generation of its deepfake detection model, Detect-2B, achieving an accuracy of approximately 94%. Detect-2B utilizes a series of pre-trained submodels and fine-tuning to analyze audio clips and determine whether they are generated by AI.

Ed Newton-Rex, the audio head of Stability AI, resigned due to his disagreement with the company's stance that training generative AI models on copyrighted works falls under 'fair use.' This move sparked widespread discussion about the concept of 'fair use' and the extensive use of content by AI models without creator permission. Newton-Rex opposes the entire industry group adopting the same approach, arguing that copyright issues extend beyond Stability AI.

Google DeepMind has launched SynthID, an AI audio watermarking technology that is imperceptible to human ears. The audio watermark is used to identify the source of AI-generated content without affecting the listening experience. It can still detect the watermark in audio that has been compressed, accelerated, or slowed down, serving as an important safeguard against the potential hazards posed by generative AI. SynthID is a method that converts audio waves into a two-dimensional visualization.